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ABSTRACT 


The federal government encourages contracting for the 
Mmurpoese of reducing operating costs. Military base 
Operating support (BOS) functions are a prime area for such 
eGentracting. However, there exists only limited review of 
how effective this policy has been. 

This thesis analyzes the results of the various 
contracting alternatives implemented by bases within 
different naval warfare communities. It was found that, in 
most cases, contracting of BOS functions did indeed result 
in reduced costs. Radtereonally; lt was founda that; most of 
the time, full base BOS contracts performed better than 


other contracting alternatives. 
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I. INTRODUCTION AND PROBLEM STATEMENT 


A. INTRODUCTION 

The federal government encourages contracting for the 
purpose of reducing operating costs. Military base 
operating support (BOS) functions are a prime area for such 
contracting. This thesis compares the four contracting 
alternatives currently used by the Navy. 

These four alternatives are: 

1. status quo--existing methods where a contract review 
has never occured; 

2. in-house contracting--contract review has occured and 
the government agency won the contract; 

3. selected function contracting--a specific function or 
set of functions has been selected for contract review 
and a private sector contractor won the contract; 

4. BOS contracting--the BOS functions of an entire base 
have been selected for contract review and a private 
sector contractor won the contract covering all BOS 
functions. 

BY. PROBLEM STATEMENT 

Considerable military dollars are spent annually on BOS 
functions and on the administration of contracts for those 
functions. However, there has been no formal attempt to 
quantitatively analyze whether successful contracting 
methods can be applied at bases which have similar missions 


and support needs. This thesis provides such an analysis by 


comparing the relative costs among contract alternatives. 


A comparison of contract performance among various 
military bases is conducted by using linear regression 
models and other econometric methods. In the regression 
models, explanatory variables are the amount of work 
measured in appropriate units (i.e., thousands of square 
yards, acres, linear feet); the dependent variable is the 
cost associated with the contracting alternative used for 
the work performed. Within sets of similar-mission bases, 
comparisons of similar functions are made among the four 
contracting alternatives. Each similar-mission "base set" 
represents a different warfare community and is comprised of 
two to four bases. The five base sets used are: Weapons 
Stations, Naval Air Stations, Submarine Bases, Naval 
Stations, and Naval Air Facilities. The comparison is made 
for the four-year period, 1984-1987. 

OMB Circular A-76, the governing regulation jen 
contracting government services, does not require that 
functions be considered for contracting, but leaves the 
decision with base commanders [Ref. 1]. The need for cost 
reductions often encourages base commanders to consider 
contracting alternatives. However, base commanders) must 
also consider the job security of current civil service 
employees, control over the work being done, and the quality 
of the service provided. The analysis of the relative costs 


among contract alternatives contained in this thesis can be 


used by base commanders to weigh the benefits of contracting 


against these concerns. 


C. THESIS ORGANIZATION 

In Chapter II, the governing federal regulation for 
contracting is described and discussed. Chapter III 
presents a detailed description of the data used, the 
regression models applied to the data, and the results for 
one (Weapons Stations) of the five base sets, (The 
remaining base sets' results are presented in Appendices A 
Emrough D.) Chapter IV states the thesis conclusions 
regarding the relative cost efficiencies between the four 


contracting alternatives. 


II. BACKGROUND 


This chapter discusses the background of the contracting 
issue, as evidenced by: 
1. the impact of the Office of Management and Budget's 
(OMB) Circular A-76 on the Federal government, 


2. how the provisions of OMB Circular A-76 have been 
applied specifically in the U.S. Navy, and 


3. the procedures required by that document. 


A. IMPACT OF OMB CIRCULAR A-76 

Historically, "functions", or tasks, YeQWairae 
government administration have included "law enforcement, 
Judicial activities, conduct of foreign policy, national 
defense, regulatory activities, tax collection, and 
financial administration of government." [Ref. 2] However, 
all of the departments and major agencies of the federal 
government are supported by functions which, since they do 
not require the direct administration of government 
employees, can be contracted to the private sector. 

Since the late 1950's, the federal government has 
encouraged the contracting of such functions. OMB Circular 
A-76 is the federal regulation governing such contracting. 
This Circular originated in bulletins issued by OMB's 
predecessor, the Bureau of the Budget, and was revised 


repeatedly throughout the 1960's and 1970's. With each 


mevVlcion, itt ehasmbecoOome More explicit concerning the 
specific procedures to be used in comparing proposed 
contractor performance with government performance. 

It has only been during the 1980's that government 
agencies have recognized the need to compete against private 
sector contractors to retain their work by winning in-house 
contracts. OMB Circular A-76 establishes contracting as a 
means of reducing government costs. This is particularly 
important because of the increasing pressure to reduce the 
federal deficit. 

There are three significant additional benefits to this 
pelicy. The first benefit is a reduction in the size of 
government. This reduction results from a corresponding 
increase in the private sector's role in providing goods and 
services to meet public sector needs. The second benefit is 
the resulting increase in government efficiency as 
government agencies strive to achieve their "most efficient 
Organization" (MEO) forms. The third benefit results from 
new insights obtained from the private sector contractor's 
Seoyvectivity. These insights are reflected in the 
contractor's methods for budgeting, staffing, conduct of 
operations, and calculation of overhead costs, personnel 


costs, and profits. 


B. OMB CIRCULAR A-76 APPLICATIONS IN THE NAVY 

Navy functions which are candidates for contracting are 
primarily base support (BOS) functions, such as facilities 
maintenance, utilities, transportation services, and similar 
support functions. Navy functions which are exempt from the 
contracting process include research, test and development, 
Maintenance of combat support capabilities, and training of 
military personnel. [Ref. 2] 

The Naval Facilities Engineering Command (NAVFACENGCOM) 
1s responsible for oversight of the base operating support 
(BOS) contracting program Navywide. In particular, data are 
collected and analyzed to assess the amount and quality of 
shore-based resources and their impact on fleet readiness. 
These shore-based resources are maintained through BOS 
funcEDons. The oversight of these BOS functions by 
NAVFACENGCOM personnel entails monitoring their programming, 


budgeting, and execution. 


C. OMB CIRCULAR A-76 CONTRACTING PROCEDURES 

Base commanders may identify functions as candidates for 
contracting, but are not required to do so. For each 
function identified, a thorough review of the function is 
conducted to evaluate its potential for being contracted, 


including determining whether it 1s exempt from such action. 


A comprehensive study of the function's cost is then 
conducted. 

Concurrently, the government agency responsible for the 
function is encouraged to assess itsS organization and 
procedures, revising these as necessary, in order to achieve 
its' most efficient organization. Such revisions should 
increase productivity and will later become required 
elements of the contract if the government agency keeps the 
function in-house (i.e., the contract becomes an in-house 
contract as defined earlier). 

The primary provision of a typical contract is the 
statement of work. The statement of work describes the work 
to be done, the standards of performance, the required 
outputs, and the financial penalties for contract default. 
Generally, the statement of work does not specify actual 
procedures unless dictated by military necessity, safety 
considerations, etc. Once the contract is awarded, whether 
back to the government agency or to an outside contractor, 
the winner must adhere strictly to the provisions of the 
Seontcract. 

Quality assurance (QA) is measured by the contract's 
standards of performance. These standards include the 
acceptable level of service and the percentage of time the 
standard is expected to be met. Although QA is the 


responsibility of the contractor, the government inspects 


contract performance to ensure compliance. Such QA 2s 
perhaps more visible in the case of private sector 
contractors; however, similar inspections are also conducted 
on in-house contracts uSing normal internal review 
procedures. 

OMB Circular A-76 also specifies requirements which 
promote fair competition between government agencies and the 
brivate sector ‘contractors. Potential private sector 
contractors are required to include in their bids surcharges 
for government administration of the contract and for the 
costs of relocating and retraining government employees as 
necessary. More significantly, the contractor's bid must 
propose a savings of at least 10% in personnel costs and 25% 
in equipment costs over the in-house bid. 

These requirements similarly apply if the government 
attempts to win back a function from a private sSe¢@uer 
contractor--the government must underbid the contractor's 
performance by these same differentials. OMB Circular A-76 
also suggests that contracts be periodically reviewed, 
usually every five years, to determine whether the nature of 
the function has changed and whether contract compliance is 


being maintained. 


D. OMB CIRCULAR A-76 APPLICATION RESULTS 
To test whether contracting reduces costs, work and cost 


data for given functions were analyzed to compare the four 


Pomernacmlunag alternatives previously defined. These 
functions included both BOS functions and operational 
functions related to the base's mission. The next chapter 
describes the data, the linear regression models, and the 
analytical results for one base set. Appendices A through D 
contain the analytical results for the remaining four base 


sets. 


IIIT. ANALYSIS 


This chapter describes the data, the linear regression 
models, and provides an analysis of the data. Linear 
regression models were chosen because preliminary review of 
the data indicated a possible linear relationship between 
the work and cost data that were used. The models are 
illustrated using data from one of the five base sets: 
Weapons Stations, Naval Air Stations, Submarine Bases, Naval 
Stations, and Naval Air Facilities. The analytical results 
for the remaining four base sets are presented in Appendices 
A through D. All analytical results pertain to the four- 
year period of this study, 1984-1987. Because of mission 


dissimilarities, comparisons among base sets were considered 


unrealistic. 
Ae DATA 
aN 22 Sources 


The primary data source for this thesis was the Real 
Property Maintenance Activity Execution Report (RPMA) [Ref. 
a iiee Naval bases annually make this report to Naval 
Facilities Engineering Command (NAVFACENGCOM). The purpose 
of the RPMA is to monitor the condition and use of shore 
facilities in an attempt to reduce deficiencies which may 


impact fleet readiness. 


1G) 


RPMAs include data on those management and 
engineering functions involved in shore facility maintenance 
and operation, including the maintenance and repair of real 
PmoODerey, sucimerties, manor constrWction, and other 
engineering support. In particular, the RPMA provides the 
written justification used to set minimum funding levels for 
real property maintenance and provide control over backlogs 
of maintenance and repair work. The RPMA data used for this 
analysis are the amount of work units performed and the 
associated costs for certain BOS and operational functions. 

The secondary data source for this thesis was the 
Detailed Inventory of the Naval Facilities Assets Data Base 
(NFADB). The purpose of the NFADB is to determine 
requirements and funding for new facilities, identify excess 
shore facilities, and provide a basis for real property 
maintenance funding. This source augmented the RPMA data 
when complete data were not available. The appropriateness 
of mixing data from these two sources was justified by 
comparing data values from both sources when available. The 
exact match of these comparisons implied that the same data 
was being reported to both sources. 

2. Selection of Variables 
a. General Considerations 
The work and cost data for similar functions, 


obtained from the RPMA, were aggregated to form "functional 


Jat 


area variables". These functional area variables were used 
to represent both BOS and operational functions. The BOS 
functional area variables were the variables of interest for 
this thesis. The operational functional area variables were 
used only with the first "preliminary" regression model. 
Because of a small number of data points, the 
first model was used for exploratory data analysis in 
determining the relationship between work performed and 
costs incurred. This initial model was also used to ensure 
that the two major assumptions of regression, normality of 
the residuals and equality of residual variances, were 
applied. The first model also provided a means to determine 
1f any multicollinearity or autocorrelation existed among 
the data. 
The functional area variables for the Weapons 
Stations (WPNSTA) base set are described in the following 
section. The remaining base sets’ functional area 
variables are described in their respective appendices. 
b. Weapons Stations' Functional Area Variables 
The three Weapons Stations selected for this 
thesis were WPNSTA Seal Beach, WPNSTA Concord, and WPNSTA 
Yorktown. Each is a primary support base for surface ships 
and aircraft, providing ammunition by truck and \raiuae 
pierside, and at anchorage. Six functional area variables 


were considered for these bases. Because data waS missing 
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Poresome years and some Eunctional area variables, 
estimation was necessary. Nine missing data points were 
estimated, representing 6% of the data used for this base 
set. A description of the six functional area variables and 


their units of measurement is provided in Figure 1. 


DESCRIPTION OF VARIABLES 


COMN -- community buildings (thousands of square feet) 

GRND -- improved grounds (acres) 

EMERG -- emergency service work (number of calls 
received) 

UTILS -- electricity, water and refrigeration (thousands 


of linear feet) 


CLEAN -- pest management and custodial services 
(thousands of square feet) 


TRASH -- garbage disposal (thousands of cubic yards) 


Figure 1. Description of Weapons Stations Variables 


Of these six functional area variables, only 
Srp and CLEAN had known contracting histories. The 
remaining four represent the status quo contracting 


alternative, never having been selected for contract review. 
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Bis MODELS 
1. General Considerations 
The initial model used was a simple Jinmemn 


regression model of the form: 


Y =a +t bX +52 

This model was chosen because a preliminary review 
of the data indicated a possible linear relationship between 
the dependent and independent variables. The amount of work 
performed in a given functional area served as the 
independent variable, x, while the associated annual cost 
was the dependent variable,y. The disturbance or error term 
of the equation 1s shown by u. The coefficient, a, is the 
intercept term, which indicates the value of y when “23s 
Zero. The dimensions of the coefficient, a, are dollars. 
The coefficient, b, is the slope coefficient, whugem 
indicates the amount of change in y when x changes by one 
Wma, &. The dimensions of b are dollars per unit for the 
given functional area variable. 

The simple linear regression model was chosen 
because X-Y plots of the work unit data versus cost data 
tended to show a linear relationship between the dependent 
and independent variables. The first model was applied to 
all work and cost data for each functional area variable 


used in the base set. 
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A second regression model, which also assumed a 
linear relationship between the dependent and independent 
variables, was applied to only those functional area 
variables in each base set having known contracting 
histories: 

3 
Y= at b4X4 + DoX5 Ly a 6,Ww; + u. 
aFL 

The second model was used to compare the four 
contracting alternatives. It was conceptually similar to 
the first simple regression model, but included a second 
independent variable of employee costs (including total 
Salaries and employee benefits), x2, and dummy variables 
representing the different contracting alternatives, Ws - 
The Wa is binary, and acts as a switch, taking on the value 
zero for contracting alternatives not used for a given 
functional area variable, and taking on the value one for 
contracting alternatives that are used. 


The coefficients are a, b and c:. The a and ba 


es i 
Meertticients are the same as a and b described for the first 
model. The D5 coefficient is dimensionless. The oe 


coefficient represents an additional cost associated with 


the different contracting alternatives. 


ie 


2. Evaluation Measures And Expectations 

As the emphasis of this thesis was on evaluating the 
ability of functional area variables to explain their 
associated costs, the primary criterion for the first model 
was the fit of the data to the model. This fit was measured 
by R-squared (R-), the coefficient of determination. The R? 
statistic is the ratio of the explained sum of squares to 
the total sum of squares, or the proportion of variation in 
the dependent variable that is explained by the independent 


Z 


variable. The R“ statistic lies between values of zero and 


one. The higher the R? 


statistic, the closer the data fits 
the regression model. 

The fit of the data to the model was also measured 
by the significance level of the regression, p, for the null 
hypothesis that the functional area variables and the cost 
are independent (Ho: Base the set of explanatory variables 
has no influence in the determination of y). Lower values of 
p less than 0.10 are preferred. 

Using the STATGRAPHICS software package, ordinary 
least squares (OLS) regressions were performed for both 


models. For both models, the R2 


and p statistics were used 
as the primary measures of the statistical fit of the data 


to the model. 
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For the second model, the t statistic was also used 
Moememeasire the COntEribution to costs of the dummy 
Pemtracting variable (Ho: c.=0). The null hypothesis is 
rejected if the calculated t statistic is greater in 
absolute value than the critical t statistic value, which is 
obtained from t tables for a selected level of significance 
and the appropriate degrees of freedom. As with the overall 
regression significance level, p, the significance level of 
mment statistic, r, is ideally small to indicate the 
probability of observing a calculated t value greater than 
the critical value when the null hypothesis is correct. 

It was expected that the process of contractual 
review would permit the realization of greater cost 
efficiencies. Regardless of whether the work was retained 
in-house or contracted out, cost decreases were anticipated 
for constant amounts of work performed. Further, ti was 
expected that BOS contracts would result in greater cost 


efficiencies than in-house or selected function contracts 


due to economies of scale. 


C. WEAPONS STATIONS BASE SET RESULTS 
1. Model il 
The first simple regression model was applied to the 
Six Weapons Stations base set functional area variables 


MeOMN, GRND, EMERG, UTILS, CLEAN, TRASH). 


dey, 


a. Regression Significance 
Table 1 provides the R2 and p statistics for the 


combined and individual bases. 


TABLE 1. R“ STATISTICS AND SIGNIFICANCE LEVELS 


Ra SO. (R7) COMN GRND EMERG UTILS CLEAN TRASH 


Combined O09 0.08 Oe), 0.42 O02 0.44 


Seal Beach O52 Oa 0.96 Oma 0.83 0.27 


Concord 0.82 0.2655 O03 ORO tT 0.52 0.96 
Yorktown O235 Opals Om oe 0.63 0.87 0.9m 
SiG. BEVEL (p) 

Combined 0.36 0.39 0.00 0.02 0.66 0.02 


Seal Beach 0.26 Oe Orr Ons 9 0.09 O743 
Concord 0.09 0.08 0.83 0.89 0.28 OTe2 


Yorktown 0.41 Oe6i 0.04 O21 0.07 0.05 


Table 2 explicitly identifies those regressions 
which reflect significant dependence (p<=0.10) of the 
functional area variables and their associated costs. Use of 
Similar simple regression techniques could be used by base 
commanders to provide quantitative evaluation of the 


performance of other BOS functions. 
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TABLE 2. REGRESSIONS WITH SIGNIFICANT DEPENDENCE 


COMN GRND EMERG UTILS CLEAN TRASH 


Combined xX X X 
Seal Be X X 

Concord 4 x 4 
Yorktown A X xX 


In the sections that follow, the combined bases 
are used to illustrate additional regression and econometric 
methods. Although not all of the combined variables showed 
Significant dependence between the dependent and independent 
variables, the continued use of the combined variables as a 
complete set is maintained for illustrative purposes and for 
consistency's sake. 

b. Residual Analysis 

Figure 2 presents the component-residual plots 

for the combined bases for each of the six functional area 


variables. 
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Figure 2. Component-Residual Plots 
(continued) 


Ideally, the residuals for all bases within a 
Given base set should be randomly distributed if the data 
are independent of the bases. However, all six component- 
residual plots show the data strongly clustered by base. 
This shows that the regressions were not only dependent on 
the work and cost data, but also on the bases for which the 
data were obtained. Therefore, this indicates that a third 
explanatory variable might be appropriate to account for the 
source (military base) from which the data were obtained. 

c. Anticipated Modeling Concerns 

(1) Data Inconsistencies. Data points were 

estimated when the data entries were missing or inconsistent 


with expected operational procedures. Such inconsistencies 
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were most probably the result of a realignment of costs to 
different cost accounts, human error, Or intent iomas 
mMisrepresentation of the amount of work performed. 
Estimation was based on trends of similar data, historical 
sources being available in all cases. No more than 8% of all 
data points were estimated for each base set. 

The effects of estimating data include a 
reduced residual variance, which results in a greater 
likelihood of meeting the significance criteria for R? and p 
which were previously defined. For each base set, those 
functional area variables for which data points were 
estimated were checked for artificially high significance. 
For the Weapon Stations base set, three of the s1x 
functional area variables were significant for the combined 
bases, although only one of these included estimated data. 
It was concluded that the estimated data points did not 
unduly affect the regression results. 

(2) Autocorrelation. Because the first model 
used only one explanatory variable, it was expected that 
autocorrelation might occur as a result of unwsequwen 
unavailable explanatory variables. Further, autocorrelation 
could have resulted from specification error in the model or 
measurement error of the dependent variable. The latter was 
of particular concern due to the inconsistencies previously 


noted in the data. 


De 


The analysis of variance tables produced by 
STATGRAPHICS provided Durbin-Watson statistics. Aes y= 
Watson statistics are used to test the null hypothesis of no 
serial correlation. Upper and lower critical values, d,, and 
dj. are provided in tables for selected levels of 
significance, number of observations, and degrees of 
freedom. The null hypothesis is rejected if the Durbin- 
Maeson Statistic as less than d, and accepted if greater 
Doan d,- Ihe test is inconclusive if the Durbin-Watson 
statistic falls between these critical values. Using the 
Savin-White tables of Durbin-Watson values [Ref. 4], the 
Durbin-Watson test was applied to each of the combined 
variables within each base set. Where autocorrelation was 
found to exist, the data were transformed to eliminate the 
autocorrelation and the Durbin-Watson test run again to 
verify the absence of autocorrelation after transformation. 

For the Weapons Stations base set, the 
functional area variables for the combined bases were tested 
Mor autocorrelation, and their Durbin-Watson (D-W) 
statistics were computed. With 12 observations, 2 degrees 
of freedom, and 1% significance, the values for d, and d,, 
were .569 and 1.274, respectively. Of the six variables, 
one, COMN, revealed no autocorrelation and the other five 


fell within the inconclusive region. 
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(3) Heteroscedasticity. The potential tox 
nonconstant variance was considered due to the cross-section 
data used. A simple preliminary check was made by examining 
the residual plots for any "horn-shaped" or "fan-shaped" 
distributions. Because none of the variables in any of the 
five base sets indicated this type of distribution, no 
formal test was performed. 

(4) Multicollinearity. Multicollinearity 
occurred rarely as a result of constant values reported for 
the explanatory variable over the entire four-year period. 
In these few instances, the STATGRAPHICS software reported 
the existence of collinearity and eliminated that variable 
from the regression model. Collinearity was absent from the 
six Weapons Stations functional area variables. 

(5) Test For Structural Change. Using the Chow 
test, the data were also tested for structural change of 
slopes and intercepts over the four year period. The Chow 
test 1s a specialized application of the F-test that 
identifies whether significantly different regression 
coefficients are calculated for different data samples in 
the same theoretical model. F statistics were computed and 
compared to F distribution table values for the appropriate 
degrees of freedom parameters [Ref. 4]. 

In all cases where structural change was 


indicated, X-Y plots of the data were reviewed to verify 
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these results. As with previous modeling problems, the 
structural change was believed to result from the data 
inconsistencies discussed earlier, most notably changes in 
the base's interpretation of data reporting requirements. 
When the Chow test was applied to the 
Weapons Stations base set, the F(.05) table value was 4.46 
for 2 and 8 degrees of freedom. Five of the six F values 
(COMN, GRND, EMERG, CLEAN, TRASH) fell below this table 
value; therefore, the hypothesis that no structural change 
occurred could not be rejected for those five functional 
area variables. The calculated F value for the UTILS 
functional area variable was above the 4.46 table value, 
indicating structural change. 
(6) Summation of Modeling Tests. Table 3 
Summarizes the results obtained from the hypothesis tests 
discussed in sections (2) and (5) above. 
2. Model 2 
As previously noted, Model 2 is conceptually similar 
to Model 1. Model 2 differs in three ways: 


1. at is applied to only those variables with known 
contracting histories; 


2. it includes a second explanatory variable representing 
employee costs; and 


3. dummy variables are used to reflect the different 
contracting alternatives in use within a given base 
set. 
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TABLE 3. SUMMATION OF MODELING TESTS 





VARIABLE TESons 
AUTOCORRELATION STRUCTURAL CHANGE 

COMN Accept Ho Accept Ho 
GRND Inconclusive Accept Ho 
EMERG Inconclusive Accept Ho 
UTIs Inconclusive Reject Ho 
CLEAN Inconclusive Accept Ho 
TRASH Inconclusive Accept Ho 


a. Application of Model 2 

Table 4 presents the estimated coefficients for 
Model 2 for the Weapons Stations' functional area variables. 
These coefficients are reported for Model 2 only, because 
Model 2 addresses the problem statement of this thesis--the 
measurement of the relative cost efficiencies of the 
adifferent contracting alternatives. In contrast, Model 1 is 
merely a simple regression model and does not provide any 
Significant information other than fitting a line to the 


data. 
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TABLE 4. MODEL 2 REGRESSION COEFFICIENTS 


VARIABLE a-hat b,~hat bo-hat Cs-hat 
GRND (1i=1) 2872.56 1835295 OF 02 31150.92 
CLEAN (1=2) 9359.69 0.09 0.00 14676.04 
i= 1 = in-house contract 
2 = selected function contract 


b. Data Considerations 

For the six Weapons Stations' functional area 
variables only two, GRND and CLEAN, had known contracting 
histories. Of the three Weapons Stations, only WPNSTA 
Concord did not use the status quo contracting alternative. 
Concord had won the GRND (grounds maintenance) contract in- 
house and a private sector contractor had won the CLEAN 
(custodial services) contract as a selected function 
eomteract. 

The amount of acreage covered by Concord's in- 
house GRND contract fell between the amounts of acreage at 
the other two bases. This is advantageous for comparing the 
in-house contracting alternative at Concord with the status 


quo contracting alternative at Seal Beach and Yorktown. 
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In contrast, the amount of area Covered 
Concord's selection function CLEAN contract 
Significantly less than the area covered by the other two 
bases. This, and the fact that Concord's contract was 
confined to pest management services only, explains why 
Concord incurred relatively small costs for this functiomam 
area. 

An unexplainable anomaly was found in the cost 
of WPNSTA Concord's "housekeeping tasks", as measured by the 
CLEAN and TRASH functional areas. Although Conecome 
supported a larger population and had higher employee costs 
than the other Weapons Stations, it performed these tasks at 
less cost. 

c. Regression Significance 

Table 5 presents the R? statistics; the 
regression significance level, p, measuring the fit of the 
model; and the t statistics with their respective 
Significance levels, r, for the GRND and CLEAN models. As 
described earlier, the t values were used to measure the 
influence of the dummy contracting variables on costs. The 
t values reported in Table 5 are both significant at a level 


of significance of .05 for 8 degrees of freedom. 
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TABLE 5. REGRESSION STATISTICS AND SIGNIFICANCE LEVELS 








VARIABLE R- p t r 
GRND ys 0.006 4.186 0.003 
CLEAN 0.53 0.095 2.265 0.053 


dad. Cost Trends 
For both the CLEAN and GRND functional area 
variables, increases in the amount of work performed caused 
an expected rise in costs, with CLEAN showing a significant 
increase. However, increases in employment costs resulted 
in no change in overall costs for either CLEAN or GRND at a 
Significant level. This may have been due to the 
eerciciencaes of the contract. 
e. Effects of Contracting Alternatives 
Both the GRND and CLEAN models experienced 
increased costs for the dummy variables at extremely high 
Significance levels. Thiswandicates that the contracts 
themselves resulted ab 21 increased costs. This 
counterintuitive result does not adequately explain the 


relationship between contracting and costs. A better 


description of this relationship is possible by examining the 
data reported. 

(1) The GRND Data. WPNSTA Seal Beach maintain- 
ed the GRND function using a status quo contracting alterna- 
tive. This base reported unusually low work units performed 
for the variable GRND (3 to 5 acres out of a total land area 
of nearly 14000 acres), and costs which dropped from 
$21,000 to $8,000 after the first year of the study. While 
this data may be accurate, it provides such extreme outliers 
as to question whether the data truly reflected the actual 
work being performed, as well as the true costs incurred. 

One obvious reason for incorrect data 1s 
that errors may have occurred in properly recording the data 
in the required format. A second possible reason is the 
intentional misrepresentation (1.e., "gundecking") of the 
data by those who are assigned the tedious task of reporting 
Ata A third reason, of more serious consequence, is that 
the reporting of extreme data may indicate a deliberate 
attempt to avoid a possible contract review of functions 
that might otherwise be of sufficient magnitude and cost. 

WPNSTA Yorktown also maintained the GRND 
function at the status quo. However, unlike WPNSTA Seal 
Beach, costs more than doubled during the four-year period 


while the amount of work performed increased by only 5%. 
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In contrast to both of the above bases, 
WPNSTA Concord had won the GRND contract in-house. While the 
amount of work performed increased only slightly, costs 
decreased by a total of $16,000 during the four-year period. 
It is believed that the dummy variable 
representing contracting reflected significantly increasing 
costs due to the fact that Yorktown performed nearly twice 
as much work as Concord at an average cost of 40% less than 
@omcord. In essence, the cost-reducing effect of Concord's 
contract is lost in the sheer volume of Yorktown's work. 
Mie etfect of Concord’s contract is evident in the trend of 
decreasing costs at concord versus the trend of increasing 
costs at Yorktown. This implies that the conclusion that 
Pentracts increase costs reached from Model 2 is incorrect. 
This may be due to incorrect data, as discussed previously, 
or because the volume of work performed by one base simply 
overshadows the amount of work performed by another base. 
(27> The™CLEAN Data For the variable CLEAN, 
Seal Beach reported a cost increase over the four year 
ferred Of 50%, although work output rose by only 0.13%. 
Yorktown's costs decreased 52% over the first three years, 
then rose 36% during the fourth year, while work output only 


increased by 1.3% over the four-year period. 


uit 


WPNSTA Concord, under its selected function 
CLEAN contract, performed considerably less work than the 
other bases, with output increased by only 11 work units and 
costs decreased by a total of $6,000. As with the GRND 
variable, the disparity in the volume of work performed 
between Concord and the other Weapons Stations caused an 
overall increase in costs for the combined bases. However, 
the performance of the individual bases shows that 
contracting reduced costs during the same time period in 


which not contracting increased costs. 


D. REMAINING FOUR BASE SETS 

The comparison results for the remaining four base sets 
(Naval Air Stations, Submarine Bases, Naval Stations, and 
Naval Air Facilities) are contained in Appendices A through 
Be The following chapter summarizes the analysis results 


for all five base sets. 


Bi 


IV. CONCLUSIONS 


A. SUMMARY STATISTICS 

Seven of the 13 bases (54%) included in this thesis used 
some form of contracting. Contracts were awarded on 38 of 
the 46 functions (83%) studied. Twelve of these 38 
functions (32%) were "well fit" by the regression models. 
These regression models were used to explore the 
relationship among the amount of work performed, the 
contract alternatives used, and the associated costs. The 
twelve functions determined to have good fits to the 
regression models are used as the basis for the summarized 


results which follow. 


Pee RESULTS BY CONTRACT .TYPE 

In-house contracting was compared to the status quo 
contracting alternative for two of the twelve functions. 
In-house contracts were more cost-efficient for both (100%) 
of these comparisons. 

In~house and BOS contracting were compared for six of 
the twelve functions. BOS contracts were more cost-efficient 
for four (67%) of these comparisons. 

Selected function contracting was compared to the status 


mer LOr 3 of the twelve functions. Selected function 


sie 


contracts were more cost-efficient for two of the weber 
(67%) comparisons. 

BOS contracting was more cost-efficient than the status 
quo contracting alternative in the one case (100%) where 
this comparison was made. 

Table 6 Summarizes the comparisons made between 
contracting alternatives. The table entries reflect the 
percentage of comparisons in which the contracting 
alternative on the vertical axis performed more efficiently 


than the alternative on the horizontal axis. 


TABLE 6. SUMMARIZATION OF CONTRACTING COMPARISONS 


STATUS IN- SELECTED 
QUO HOUSE FUNCTION BOS 
STATUS QUO = 0% 33% 0% 
IN-HOUSE 100% =; = 338 
SRUBCTED £UNCTION 67 % = = = 
BOS 100% 67 % = = 


Based on the above comparisons, the following cost- 
efficiency hierarchy was inferred for the four contracting 


alternatives: 
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(1) BOS 
(2) In-house 
(3) Selected function 


(4) Status quo 


Selected function contracting was not placed higher in 
the hierarchy because it did not perform as well as in-house 
and BOS contracting when compared with the status quo. 

This hierarchy was intuitively expected; and validates 
the general contracting policies of OMB Circular A-76 and 
the BOS contracting programs of NAVFACENGCOM. The above 
one-to-one comparisons and hierarchy answer the problem 
statement presented at the beginning of this thesis by 
giving base commanders quantitative information on the 
relationships between work performed, costs, and contract 


types. 


C. FINAL REMARKS AND RECOMMENDATIONS 

As discussed in this thesis, a number of factors 
disrupted a smooth comparison between bases. These included 
disparities in work output, incorrectly recorded data, and 
suspected intentionally incorrect data. In spite of these 
deficiencies, however, it is felt that this thesis provides 
greater justification for the additional use of contracting. 
If similar quantitative analysis is performed regularly, 


more base commanders might be encouraged to perform 
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contracting, resulting in significant reductions in Bbaee 
operating support costs. Additionally, it may be possible 
to attain a more efficient organization either through the 
revitalization of existing in-house operations or through 
the application of new methodologies and organizational 
designs as proposed by outside contractors. Finally, with 
the efficiencies realized through the contracting process, 
Support of the Fleet through shore establishment readiness 


can only be improved. 
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APPENDIX A. NAVAL AIR STATIONS RESULTS 


Using the procedures described in Chapter III of this 
thesis, the following results were obtained for the Naval 


Air Stations base set. 


A. Naval Air Stations' Functional Area Variables 

The four Naval Air Stations selected for this thesis 
were NAS Cecil Field, NAS Oceana, NAS Miramar, and NAS 
Lemoore. Each 1S a primary support base for carrier air 
Wings and serves as a homeport for a variety of aircraft 
ancluding the F-14, S-3, A-7, and F-18. Seven functional 
areas variables were considered for these bases. A 
description of the seven functional area variables is 
provided in Figure A-1. 

Of these seven functional area variables, only GRND, 
Perio and STOR had known contracting histories. The 
Mmmalning four represent the status quo contracting 


alternative, having never been selected for contract review. 


B. Model Results 
1. Model 1 
The first simple regression model was applied to the 
seven Naval Air Stations base set functional area variables. 


The data from Miramar and Lemoore were analyzed separately 


ow 


from the Oceana and Cecil Field data; this was due to how 


the data originally became available for study. 


DESCRIPTION OF FUNCTIONAL AREA VARIABLES 
KSF -- aviation operations, maintenance and production 
buildings (thousands of square feet) 


RUNWAY-- airfield runways and other airfield pavements 
(thousands of square yards) 


UTILS -- heating, water, sewage, and air conditioning 
(thousands of linear feet) 


STOR -- supply storage (thousands of square feet) 
OTHFAC-- navigation and traffic aids, land operations and 
aircraft maintenance/production facilities, 


other than buildings (per each item) 


PAVEMT-- roads and streets, other surfaced areas, 
sidewalks (thousands of square yards) 


GRND -- improved, semi-improved and unimproved grounds 
(acres) 
Figure A-1. Description of Naval Air Stations 


Functional Area Variables 


a. Regression Significance 


Z 


Table A-1 provides the R“ statistics for the 


combined Miramar and Lemoore bases. Table A-2 provides the 


R2 


statistics for the combined Oceana and Cecil Field bases. 
Both tables explicitly identify those regressions which 


reflect dependence at a level of significance of p<=0.10. 
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Pee ie A= ie R- STATISTICS AND SIGNIFICANCE LEVELS 
MIRAMAR AND LEMOORE 


VARIABLE RosOe.) otG.) LEVEL 


RUN 0.47 OF 06 
UTILS On 9 G.00 
STOR G.36 Gze3 
GRND 0.40 or O09 


TABLE A-2. R? STATISTICS AND SIGNIFICANCE LEVELS 
OCEANA AND CECIL FIELD 


VARIABLE R SQ. SIG. LEVEL 
PAVEMT 0.2 Greil) 
GRND On 0.004 


b. Residual Analysis 
The seven component-residual plots showed the 
data clustered by base. As was concluded in Chapter III, 
this indicated that the regressions were not only dependent 
on the work and cost data, but also on the bases for which 
the data were obtained. 
c. Tests For Anticipated Modeling Concerns 
(1) Data Inconsistencies. Data entries were 


estimated for 24 missing data points (less than 4% of all 
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data points). Those functional area variables for whem 
data points were estimated were checked for artificially 
high significance. Because of the paired sub-sets used in 
the Naval Air Station base set, comparative assessment could 
not be made, although the estimated data did not exceed 4%. 

(2) Autocorrelation. For the Naval Air Stations 
base set, the functional area variables for the combined 
bases were tested for autocorrelation by computing and their 
Durbin-Watson (D-W) statistics. With 16 observations, 2 
degrees of freedom, and 1% significance, the values for dy 
and d,, were .737 and 1.252, respectively. One functional 
area variable's D-W statistic yielded a value less than dy 
and greater than zero, thus indicating autocorrelation. 
After transforming the data, the autocorrelation was 
resolved. Of the other functional area variables, five 
statistics did not show autocorrelation; while one 
Statistics fell within the inconclusive region. 

(3) Heteroscedasticity. The clustering of data 
by base and the overall spread of observations did not 
indicate that heteroscedasticity was likely; therefore, no 
formal tests were performed. 

(4) Multicollinearity. Multicollinearity was 
absent from the seven Naval Air Stations functional area 


variables. 
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(5) Test For Structural Change. When the Chow 
test was applied to the Naval Air Stations base set, the 
F(.05) table value was 4.10 for 2 and 10 degrees of freedom. 
The calculated values for four functional area variables 
mer below =this table value, indicating no structural 
change. For three functional area variables, RUNWAY, UTILS, 
and GRND, the calculated values were greater than the table 
value, indicating structural change. 

(6) Summation of Modeling Tests. Table A-3 


summarizes the results obtained from the hypothesis tests 
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discussed in sections eae and GS") above. 
TABLE A-3. SUMMATION OF MODELING TESTS 
VARIABLE AMA Sy is 
FUTOCORRELAT LON STRUCTURAL CHANGE 

Keo E RECepDt He Accept Ho 
RUNWAY Inconclusive Reject Ho 
BLTLS Recept Ho Reject Ho 
SlLOR Accept Ho Accept Ho 
OTHE AC Accept Ho Accept Ho 
PAVEMT Accept Ho Accept Ho 
GRND Reject Ho Reject Ho 


2. Model 2 
a. Data Considerations 

For the seven Naval Air Stations’ Eunctiomam 
area variables only GRND, UTILS, and STOR had known 
Ccontractindemn stor res Because STOR did not yield 
Significant results from the second model, it was omitted 
from further analysis. 

Of the four Naval Air Stations, NAS Cecil Field 
and NAS Oceana did not use the status quo contracting 
alternative. Oceana had won the GRND contract in-house and 
a private sector contractor had won the GRND and UTILS 
contracts at Cecil Field as selected function contraciwes 

b. Application of Model 2. 

Table A-4 presents the estimated coefficients 

for Model 2 for the Naval Air Stations' functional area 


variables. 


TABLE A~4. MODEL 2 REGRESSION COEFFICIENES 


VARIABLE a-hat b,-hat Dbo-hat cs~hat 
GRND (i=1,2) 4.66E5 a ae a -0.06 6.93E5, 5.1. 
UTELS 14a =2) 1.09E7 -6294.03 0. 7-5 ~2.63E6 
1= 1= in-house contract 
2= selected function contract 
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c. Regression Significance 
Table A-5 presents the R? Statyvctice the 
regression significance, p; and the t statistic with its 
Significance level, r; for those functional area variables 


which had significant results for Model 2. 


TABLE A-5. REGRESSION STATISTICS AND SIGNIFICANCE LEVELS 


VARIABLE R- D t r 





GRVPNI=1,2) 0.87 02.00 PAD = le, O02 
fee 3) oe 


UPEes(r=2) 208 3 0.00 Soe OZ 0.06 


i= 1= in-house contract 
2= selected function contract 


ad. Effects of Contracting Alternatives 

(1) The GRND Data. Both bases which had GRND 
contracts experienced a rise in costs as indicated by the 
dummy variables for contracting. The amount of acreage 
covered by Oceana's in-house GRND contract fell among the 
amounts of acreage at the other bases. This is advantageous 
for comparing the in-house contracting alternative at Oceana 
with the status quo contracting alternative at Miramar and 


Lemoore and the selected function contract at Cecil Field. 
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Oceana was more efficient than Miramar by 
72%, however, Cecil Field was more efficient than Oceana by 
50%. Although Lemoore was more efficient than Oceana by 44%, 
Cecil Field was still more efficient than Lemoore by nearly 
11%. Both Oceana and Cecil Field yielded significant (p=.02 
and p=.11, respectively) regressions from the second model. 
It is believed that the less significant results for Cecil 
Field's selected function contract may be due tome 
presence of a second contract in the set. 
(2) The UTILS Data. For Cecil Field, Oceana and 
Miramar, increased amounts of work required increased costs. 
However, NAS Lemoore was performing nearly 40% more work 
than Cecil Field at approximately 17% less cost. In Spams 
of the outlier effect of the Lemoore data, the trend for the 
majority of bases was reflected in a significant (p=.06) Ga 
tothe. model. This may have been due to Cecil Field's 
selected function contract balancing against the Lemoore 


data. 
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APPENDIX B. SUBMARINE BASES RESULTS 


Using the procedures described in Chapter III of this 
thesis, the following results were obtained for the 


Submarine Bases base set. 


A. SUBMARINE BASES' FUNCTIONAL AREA VARIABLES 

The two Submarine Bases selected for this thesis were 
SUBASE Bangor and SUBASE San Diego. Each iS a primary 
Support base for SSN attack submarines, while Bangor is also 
homeport to the Trident ballistic missile SSBN platform. 
Six functional area variables were considered for these 
bases. A description of the six functional area variables 


is provided in Figure B-1. 


DESCRIPTION OF FUNCTIONAL AREA VARIABLES 


PIER -- piers (in linear feet) 
OPER -- buildings related to operational functions, 
including training, maintenance, ammunition 


storage (thousands of square feet) 


SUPP -- administrative and community buildings 
(thousands of square feet) 


TROOP -- BEQs/BOQs and galley facilities (thousands of 
square feet) 
PAVE -- roads, streets and other pavements (Square 
yards) 
GRNDS -- improved grounds (acres) 
Figure B-1l. Description of Submarine Bases Functional 


area variables 
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Of these six functional area variables, all had known 
contracting histories, as SUBASE Bangor was under a full- 


base BOS contract. 


B. Model Results 
1. Model 1 
The first simple regression model was applied to the 
Six Submarine Base base set functional area variables. 


a. Regression Significance 


Table B-1 provides the R2 statistics formweme 
combined bases. The table explicitly identifies those 
regressions which reflect dependence at a level of 


Signitrecance «Of o<=0 400" 


TABLE B-1l. R2 STATISTICS AND SIGNIB@OGRIIeE Gey aa 


VARIABLE |e Oly, SiGe bE Y Eiaep} 
GRNDS OL 0.06 
TROOP 0.47 0.004 


b. Residual Analysis 
The six component-residual plots showed the data 
clustered by base. As was concluded in Chapter III, this 


indicated that the regressions were not only dependent on 
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the work and cost data, but also on the bases for which the 
data were obtained. 
c. Tests For Anticipated Modeling Concerns 

(1) Data Inconsistencies. Data entries were 
estimated for 14 missing data points (7% of all data 
points). Those functional area variables for which data 
points were estimated were checked for artificially high 
Significance. Although all of the Submarine Base functional 
area variables were estimated for one year of one base, 
three of the six functional area variables showed 


y statistics. This may indicate a possible 


Sugnaricant R 
relationship between data estimation and regression 
Significance. 

(2) Autocorrelation. The functional area 
variables for the combined bases were also tested for 
autocorrelation by computing their Durbin-Watson (D-W) 
statistics. With 14 observations, 2 degrees of freedom, and 
1% significance, the values for dy apcmd were .660 and 
1.254, respectively. Autocorrelation was not found to exist 
for four functional area variables. Of the other functional 
area variables, two statistics fell within the inconclusive 
region. 

(3) Heteroscedasticity. The clustering of data 


by base and the overall spread of observations did not 
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indicate that heteroscedasticity was likely; therefore, no 
formal tests were performed. 

(4) Multicollinearity. Multicollinearity was 
absent from the six Submarine Base functional area 
variables. 

(5) Test For Structtiral Chance. When the Chow 
test was applied to the Submarine Bases base set, the F(.05) 
table value was 4.46 for 2 and 8 degrees of freedom. The 
calculated values for three functional area variables fell 
below this table value, indicating no structural change. 
For three functional area variables, PIER, TROOP, and GRNDS, 
the calculated values were greater than the table value, 
indicating structural change. 

(6) Summation of Modeling Tests. Table B-2 
Summarizes the results obtained from the hypothesis tests 


discussed in sections (2) and (5) above. 


2. Model 2 
a. Data Considerations 
For the six Submarine Base functional area 
variables, all had known contracting histories, due to 
Bangor's BOS contract. SUBASE San Diego used the status quo 


contracting alternative. 
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TABLE B-2. SUMMATION OF MODELING TESTS 


VARIABLE TESTS 
AUTOCORRELATION STRUCTURAL CHANGE 
PIER Inconclusive Reject Ho 
OPER Accept Ho Accept Ho 
SUPP Accept Ho Accept Ho 
TROOP Accept Ho Reject Ho 
PAVE Inconclusive Accept Ho 
GRNDS Accept Ho Reject Ho 


b. Application of Model 2 
Table B-3 presents the estimated coefficients 
for Model 2 for the Submarine Bases' functional area 
variables. 
c. Regression Significance 
After fitting the data to the second model, all 
of the functional area variables reflected increased R* 


statistics. The remaining functional area variables 


(OPER,SUPP) were dropped from further analysis. 
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TABLE B-3. MODEL 2 REGRESSION COEFFICIENTS 


VARIABLE a-hat b,~-hat bo~-hat c;-hat 

Pike (1—1) 1.46E5 =a. oS O05 7.578 
OPER (1=1) 22163.94 683.22 0.00 84238795 
SUPP (1=1) =5. 625 240.12 Ogle? 7.14E5 
TROOENi—i) 1.43E6 =47832.15 0.03 -2.038a 
PAVE (1i=1) -5.61E4 316 6.1 ~Om0F 3.O01Hs 
GRNDS (1=1) 2./9E5 132255 0262 -2.06Es 


1= 1= status quo 


Table B-4 presents the R 2 statistic; (em. 
regression significance, p; and the t statistic with its 
Significance level, r; for those functional area variables 


which had significant results for Model 2. 


TABLE B-4. REGRESSION STATISTICS AND SIGNIFICANCE LEVELS 


VARIABLE R p t V6) 
PIER 0.84 0.04 1s clei O.22 
TROOP Os O2eS =O" oa 0.72 
PAVE Os 7 0203 1059 0.35 
GRNDS ORs 0.00 = 2g 0.0/5 
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ad. Effects of Contracting Alternatives 

Only GRNDS reflected any significant impact of 
contracting. In this case, the status quo was significantly 
better in performance (p=.05) than the BOS alternative. For 
the remaining functional area variables, BOS contracts did 
not result in any significant change over the status quo. 

(1) The GRNDS Data. For SUBASE Bangor, the 
number of acres covered under the GRNDS function increased 
dramatically during the last year of the study. By 
comparison, SUBASE San Diego reported less than 6% of the 
area of SUBASE Bangor. Although Bangor's costs decreased 
slightly during the four-year period, San Diego's costs were 
still only 26% those of Bangor. 

It is believed that San Diego's status quo 
methods were more efficient than Bangor's BOS contract for 
two reasons. One reason was the smaller work area covered 
by San Diego. The second reason was the dramatic increase 
in work performed at Bangor in 1987, which caused San 
Diego's data to appear more stable and more resistant to the 


effects of outlier observations. 
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APPENDIX C. NAVAL STATIONS RESULTS 


Using the procedures described in Chapter III Gf “Ghee 
thesis, the following results were obtained for the Naval 


Stations base set. 


A. NAVAL STATIONS' FUNCTIONAL AREA VARIABLES 

The two Naval Stations selected for this thesis were 
NAVSTA Roosevelt Roads and NAVSTA Diego Garcia. Each is a 
primary support base for forward deployed surface units. 
Sixteen functional areas variables were considered for these 
bases. A description of the sixteen functional area 
Varizables is provided in) Figuserc— i 

Of these sixteen functional area variables, all had 
known contracting histories, as NAVSTA Diego Garcia was 
Under a fuli-base BCs ceonrractiey NAVSTA Roosevelt Roads 
performed these functions under in-house or selected 


fUNnCtI Cha ceontractcs. 


B. MODEL RESULTS 
1. Model 1 
The first simple regression model was applied to the 


sixteen Naval Station base set functional area varzacbile—e 
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DESCRIPTION OF FUNCTIONAL AREA VARIABLES 


AVNB -- aviation operations buildings (thousands of 
square feet) 


RUN ~~ airfield runways and other airfield pavements 
(thousands of square yards) 


UTILS -- electricity, water and sewage (thousands of 
linear feet) 


STOR -- supply storage (thousands of square feet) 


PAVE -- roads and streets, other surfaced areas, 
Sidewalks (thousands of square yards) 


GRND -- improved and semi-improved grounds (acres) 
EMERG -- total building area, representative of amount of 


emergency service work performed on real 
property (thousands of square feet) 


OPER -- buildings related to operational functions, 
including communications, land operations, 
maintenance and production {thousands of square 
feet) 

SUPP -- medical and administrative buildings (thousands 


of square feet) 


TROOP -- BEQs/BOQs and galley facilities (thousands of 
Square feet) 


OTHFAC-- navigation and traffic aids, waterfront 
buildings and facilities (per each item) 


PIER -- piers (thousands of square yards) 


PERIM -- drainage facilities, fences, walls and gates 
(thousands of linear feet) 


COMN -- community buildings, MWR facilities (thousands 
of square feet) 


CLEAN -- total building area, representative of pest 
management and contracted custodial services 
(thousands of square feet) 

TRASH -- garbage disposal (thousands of cubic yards) 


Figure C-1. Description of Submarine Bases Functional 
area variables 


or) 


a. Regression Significance 
Table C-1 provides the R? statistics for tine 
combined bases. The table explicitly identifies those 
regressions which reflect dependence at a level of 
Significance of p<=0.10. 


z 


TABLE C-1. R°” STATISTICS AND SIGNIFICANCE LEVELS 


VARIABLE Keser SIG. LEVEL (p) 
AVNB 02.62: O202 
GRND OS O 2078 
OTHFAC OLS 0.04 
BE ORES) 0. 003 
PERIM G63 0.02 
CLEAN 0230 0.00 


b. Residual Analysis 
The sixteen component-residual plots showed the 
data clustered by base. As was concluded in Chapter III, 
this indicated that the regressions were not only dependent 
on the work and cost data, but also on the bases for which 


the data were obtained. 
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c. Tests For Anticipated Modeling Concerns 
(1) Data Inconsistencies. Data entries were 
estimated for 7 missing data points (5% of all data 
points). Those functional area variables for which data 
points were estimated were checked for artificially high 
significance. The Naval Station base set included estimated 
data for four functional area variables, three of which were 
Significant. This may indicate a possible relationship 
between data estimation and regression significance. 

(2) Autocorrelation. The functional area variables 
for the combined bases were also tested for autocorrelation 
by computing their Durbin-Watson (D-W) statistics. With 32 
observations, 2 degrees of freedom, and 1% significance, the 
values for dy and dy were 1.100 and 1.352, respectively. 
D-W statistics yielded values for four functional area 
variables were less than qi and greater than zero, 
indicating autocorrelation. After transforming this data, 
the autocorrelation was resolved. Of the other twelve 
functional area variables, nine statistics did not show 
autocorrelation; while three statistics fell within the 
inconclusive region. 

(3) Heteroscedasticity. The clustering of data 
by base and the overall spread of observations did not 
indicate that heteroscedasticity was likely; therefore, no 


formal tests were performed. 


oye, 


(4) eeeMudseacollineariinve Multicollinearity was 
absent from the sixteen Naval Station functional area 
variables. 

(5) Test For Structural Change. When the Chow 
test was applied to the Naval Station base set, the F(.05) 
table value was 3.34 for 2 and 28 degrees of freedom. The 
calculated values for five functional area variables fell 
below this table value, indicating no structural change. 
For the remaining eleven functional area variables, the 
calculated values were greater than the table value, 
indicating structural change. This may have been due to the 
large number of degrees of freedom (28) used. 

(6) Summation of Modeling Tests. Table C-2 
summarizes the results obtained from the hypothesis tests 
discussed in sections (2) and (5) above. 

2. Model 2 
a. Data Considerations 

For the sixteen Naval Station functional area 
variables, all had known contracting histories, due to Diego 
Garcia's BOS contract. NAVSTA Roosevelt Roads used the in- 
house contracting alternative for three of the sixteen 
functional area variables and selected function contracts 


for the remaining thirteen. 
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TABLE C-2. SUMMATION OF MODELING TESTS 


VARIABLE TESTS 


AUTOCORRELATION STRUCTURAL CHANGE 


AVNB Inconclusive Accept Ho 
RUN Accept Ho Reject Ho 
UTILS Reject Ho Accept Ho 
STOR Accept Ho Reject Ho 
PAVE Reject Ho Reject Ho 
GRND Accept Ho Reject Ho 
EMERG Accept Ho Reject Ho 
OPER Reject Ho Accept Ho 
SUPP Accept Ho Reject Ho 
TROOP Accept Ho Reject Ho 
OTHFAC Accept Ho Reject Ho 
PIER InconcluSive Accept Ho 
PERIM Accept Ho Reject Ho 
COMN Reject Ho Reject Ho 
CLEAN Accept Ho Reject Ho 
TRASH Inconclusive Accept Ho 


a7 


b. Application of Model 2 
Table C-3 presents the estimated coefficients 
for Model 2 for the Naval Stations' functional area 


variables. 


c. Regression Significance 


All of the R7 


statistics increased after the 
second model was applied to the data, however half were not 
Significant and were dropped from the analysis. Table C-4 


presents the R? 


statistic; the regression significance, p; 
and the t statistic with its significance level, r; fon 
those functional area variables which had significant 
results for Model 2. 

ad. Effects of Contracting Alternatives 

GRND and UTILS had been won as in-house 
contracts by Roosevelt Roads and were under BOS contract at 
Diego Garcia. Both functional area variables showed 
increased costs under the in-house alternative. 

For the remaining six functional area variables, 
the BOS contract was found to be more efficient for only 
one, PERIM, but not significantly. For the remaining five 
functional area variables, the selected function contracts 


were insignificantly less costly than the BOS contract. Of 


these five, CLEAN was the most nearly significant (p=.19). 
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TABLE C-3. MODEL 2 REGRESSION COEFFICIENTS 
VARIABLE a-hat b,~hat bo-hat cj7hat 
GRND (1=2) 1.58E8 = ES = Oe S70 VE? 
UTILS (1=2) 4.34E5 = 23 O OF SMS, ZOE S 
Sen {1=2) -6.85E4 7)0)3) is), 700 =3 .03E4 
AVNB (1i=3) 55870275 =O: 85 1 0200 Ti Zle Se 
RUN (1=3) 8 31SSar3 1 32248 emOOs 32701.39 
PAVE (1=3) ao Seema O 255.84 Dusl5 =5.0055 
EMERG (1=3) 4.56E5 144.94 -0.04 =5 29555 
OPER (1=3) ~8.45E5 1 SaerS 2 0.14 2. 0tbS 
SUPP.  (i=3) deo 5b 5 =2468..09 O00 9.01E5 
TROOP (1=3) a2 OOES 10 .oa. 0.10 —le 02> 
OTHFAC (1=3) 180 sive moO0O2256 O02 s6;40.34 
PEE Reeee( 1=3 =123085 5941.54 O02 -3.05E4 
PERIM (1=3) 31824.48 -26.04 OO Oui 3.527216 3 
COMN) (1=3) -2.45E6 W6925972 G22 =6.2985 
CLEAN (1=3) 3.48E5 O50: Ow. 01 SeeeOE 5 
TRASH (1=3) 1S Z256.63 222255 midis 9S SLE 83 4 


in-house contract 
3= selected function contract 
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TABLE C-4. REGRESSION STATISTICS AND SIGNIFICANCE LEVELS 


VARIABLE R? p t r 

GRND 0.92 0.01 2.086 Oe 
UTILS 0.95 0.004 0. 22g OnE 
PAVE 0.79 0.08 =0.277 meen 
OPER 0.79 0.07 ~0.713 0.52 
OTHFAC 0.88 0.03 ~0.046 0.97 
PIER 0.84 0.04 -0.425 0.69 
PERIM 0.83 0.05 1.249 0.28 
CLEAN 0.96 0.03 ~1.579 0.19 


The greater efficiency of the selected function contract was 
believed to be due to the increase in both work and costs at 
Diego Garcia with a ratio of $0.30 per square foot, whereas 
Roosevelt Roads decreased output and gradually decreased 
prices to attain a work-to-cost ratio of $0.03 per square 


Toot. 
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APPENDIX D. NAVAL AIR FACILITIES RESULTS 


Using the procedures described in Chapter III of this 
thesis, the following results were obtained for the Naval 


Air Facilities base set. 


A. NAVAL AIR FACILITIES' FUNCTIONAL AREA VARIABLES 

The two Naval Air Facilities selected for this thesis 
were NAF Midway and NAF Atsugi. Each iS a primary support 
base for forward-deployed carrier air wings and their 
staffs. Eleven functional areas variables were considered 
for these bases. A description of the eleven functional area 
variables is provided in Figure D-1. 

Of these eleven functional area variables, all had known 
contracting histories, as NAF Midway was under a full-base 
BOs “eontract. NAF Atsugi used the status quo contracting 


alternative. 


B. MODEL RESULTS 
1. Model 1 
The first simple regression model was applied to the 
eleven Naval Air Facility base set functional area 


variables. 
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DESCRIPTION OF VARIABLES 


MAINT -- maintenance and production facilities (thousands 
of square feet) 


STOR -- supply storage (thousands of square feet) 


SUPP -- medical and administrative buildings (thousands 
of square feet) 


TROOP -- BEQs/BOQs (thousands of square feet) 
COMN -- community buildings (thousands of square feet) 
UTILS -- electricity, steam and hot water (thousands of 


linear feet) 


PAVE -- roads and streets (thousands of square yards) 
GRND -- improved grounds (acres) 
EMERG -- emergency service work performed on real 


property and other equipment (number of calls) 
TRASH -- garbage disposal (thousands of cubic yards) 
CLEAN -- contracted custodial services (thousands of 


square feet) 


Figure D-1. Description of Submarine Bases Variables 


a. Regression Significance 
Table D-1 provides the R- statistics for the 
combined bases. The table explicitly identifies those 
regressions which reflect dependence at a level of 


Significance of p<=0.10. 
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TABLE D-1. R2 STATISTICS AND SIGNIFICANCE LEVELS 


VARIABLE K (SOQ) SiGe LEVEL (p) 


STOR O ee. 0.002 
SUPP CoS 0.04 
TROOP 0.86 0.001 
COMN Oe 0.003 
UTILS Cege ys! O03 
GRND Oh fh G2 008 
TRASH OW 0.008 
CLEAN 0.90 0.00 


b. Residual Analysis 


The eleven component-residual plots showed the 


data clustered by base. As was concluded in Chapter 


ek, 


this indicated that the regressions were not only dependent 


on the work and cost data, but also on the bases for which 


the data were obtained. 
c. Tests For Anticipated Modeling Concerns 
(1) Data Inconsistencies. Data entries 
estimated for 15 missing data points (8.5% of all 
points). Those functional area variables for which 
points were estimated were checked for artificially 


Significance. For the Naval Air Facility base set, 
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were 
data 
data 
high 


Ss1lx 


variables included estimated data, although only three were 
Significant. 

(2ZywAUtOCcOTrrTelatron-e The functional area 
variables for the combined bases were also tested for 
autocorrelation by computing their Durbin-Watson (D-W) 
Statistics. With 22 observations, 2 degrees of freedom, and 
1% significance, the values for d, and d,, were .914 and 
1.284, respectively. Three variables (SUPP,PAVE,TRASH) 
yielded Durbin-Watson statistics less than d, and greater 
than zero, therefore, autocorrelation was found to exist. 
After transforming the data, the autocorrelation was 
resolved. No autocorrelation was found for the remaining 
eight variables. 

(3) Heteroscedasticity. The clustering of data 
by base and the overall spread of observations did not 
indicate that heteroscedasticity was likely; therefore, no 
formal tests were performed. 

(4) Multicollinearity. Multicollinearity was 
absent from the eleven Naval Air Facility functional area 
variables. 

(5) Test For Structural Change. When the Chow 
test was applied to the Naval Air Facility base set, the 
F(.05) table value was 3.55 for 2 and 18 degrees of freedom. 
The calculated values for two functional areas fell below 


this table value, indicating no structural change. For the 
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remaining nine variables, the calculated values were 


greater than the table value, indicating structural change. 


(6) Summation of Modeling Tests. Table D-2 


summarizes the results obtained from the hypothesis tests 
above. 


discussed in sections (2) and (5) 
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TABLE D-2. SUMMATION OF MODELING TESTS 
VARIABLE TESTS 
AUTOCORRELATION STRUCTURAL CHANGE 
MAINT Accept Ho Accept Ho 
STOR Accept Ho Accept Ho 
SUPP Reject Ho Reject Ho 
TROOP Accept Ho Reject Ho 
COMN Accept Ho Reject Ho 
UTILS Accept Ho Reject Ho 
PAVE Reject Ho Reject Ho 
GRND Accept Ho Reject Ho 
EMERG Accept Ho Reject Ho 
TRASH Reject Ho Reject Ho 
CLEAN Accept Ho Reject Ho 


2. Model 2 
a. Data Considerations 
For the eleven Naval Air Facility functional 
area variables, all had known contracting histories, due to 
Midway's BOS contract. NAF Atsugi used the status quo 
contracting alternative. 
b. Application of Model 2 
Table D-3 presents the estimated coefficients 
for Model 2 for the Naval Air Facilities' functional area 
Variables. 
c. Regression Significance 
The second model yielded increased R* statistics 
for all eleven variables, although MAINT and EMERG were 
Stil Iansiontbrcant. UTILS, which had been SignificGane 
(p=.03) “an the -Elrst moce® with van R* of .58 was not 
Significant for the second model (p=.25). The variabwee 
MAINT, UTILS and EMERG were, therefore, omitted from the 
remainder of the analysis. 
Of the eight remaining variables, PAVE 
> 


increased in significance from an R~ Statistic Ge. 0) oe 


first model to .98 (p=.0005) in the second model. 
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TABLE D-3. MODEL 2 REGRESSION COEFFICIENTS 


VARIABLE a~hat b,-hat bo-hat c;—-hat 
MAINT (1=1) 1.44E5 ao 3 pales: imozeS 
STOR (1=1) 3202.87 a2. a 0.0558—59820.04 
SUPP (1i=1) S9870.22 a5), 07 =0'.65 1.66E5 
TROPP (1i=1) les 3ES 801.45 0.88 -1.54E5 
COMN (1=1) -8.84E4 743.83 0755. 67956. 24 
UTES) (1=1) FA SPARS =3 65107 © 6, 5 3.00E6 
PAVE (1i=1) ~6.69E4 98.73 OS ay i SOS 
GRND (1=1) -4.71E4 bl 2 345 G55 ~4.55E4 
EMERG (1i=1) =1,11E4 OS 59 0.06 =e OES 
TRASH (1=1) -4.30E4 2577.40 =Unc0 $6539.17 
CLEAN (1=1) -5.16E4 15ers O67 =e oOIES 

1= 1= in-house 
2 


Table D-4 presents the R statistic; the 


regression significance, and the t statistic with its 


Dp; 


Significance level, r; for those functional area variables 


which had significant results for Model 2. 
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TABLE D-4. REGRESSION STATISTICS AND SIGNIFICANCE EEE. 





VARIABLE Re p t r 
STCGR O82 O S016 TOG? 0.80 
SEE 0.86 C203 2055 0.04 
TROGE O29S O01 =e OS OS 
COMN On 9d 0.02 0.324 0.76 
PAVE 0298 02007 es) S) 0.62 
GRND O25 0.01 =1 062 O35 
TRH OPENS, 0302 ifose Se? (0) 
CLEAN Oro Ohi. = Ten 0216 
dad. Effects of Contracting Alternatives 
Four of the eight variables showed cost 


decreases with the use of BOS, although only two of these, 
SUPP and PAVE, were significant (p<=.04). The remaining 
four variables were only marginally more cost-efficient 
under the status quo contracting alternative. 

For those variables indicating greater efficiency 
with BOS contracting, NAF Midway performed less work than 
NAF Atsugi. Midway's costs decreased for these variables, 


while Atsugi's costs increased. For example, f£0r Jie 
variable SUPP, Midway spent an average of $0.35 per square 
foot compared with $0.60 at NAF Atsugi. For the variable 
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PAVE, Midway expended approximately $0.05 per square yard, 
while Atsugi's costs were a considerablely higher $0.65. 

For those variables which reflected a marginal 
favoring of the status quo over BOS contracting, NAF Atsugi 
again saw an increase in work for TROOP, but a decrease in 
eweEput for CLEAN. Costs for these variables peaked, then 
decreased. In contrast, Midway again saw drastic reductions 
in the amount of work performed after 1984 and concomittant 
drops in costs incurred, although these began to increase in 
the last year. 

Atsugl paid only slightly more per square foot 
of troop space ($0.63 versus $0.52), but was considerably 
more efficient in terms of custodial services ($0.93 versus 
eee 52) . It is contended that because Atsugi increased its 
output while decreasing costs for the variable TROOP, it 
achieved a fairly significant advantage over Midway, which 
greatly decreased output but started to significantly 
increase costs toward the end of the period. Although not 
achieving a similarly significant work-to-cost ratio for 
CLEAN, Atsugi still displayed greater efficiency when 
compared with Midway's considerably higher work-to-cost 


maclo. 
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